MODEL-BASED GRAYSCALE REGISTRATION OF 

MEDICAL IMAGES 

CROSS REFERENCE TO RELATED APPLICATION 
5 [0001] The subject matter of this application is generally related to the subject matter 

of commonly assigned, co-pending U.S. Patent Application No. , entitled 

"Facilitating Computer- Aided Diagnosis, Comparison, And/Or Display Of Medical 
Images" and filed concurrently herewith, the entirety of which is incorporated herein by 
reference. 

10 

BACKGROUND OF THE INVENTION 
!• Field of the Invention 

[0002] This patent specification relates generally to display and/or computer aided 
diagnosis (CAD) of medical images. More specifically, methods and systems grayscale 
15 registration of two or more medical images such as mammograms for facilitating visual 
comparison thereof and enhancing the speed and reliability of CAD detection of medical 
abnormalities are disclosed. 

2. Description of Related Art 

20 [0003] Systems for computer-aided diagnosis ("CAD") assist radiologists in the 

detection and classification of abnormal lesions in medical images. The purpose of such 
devices, as described in U.S. Pat. No. 5,815,591 entitled "Method and Apparatus for Fast 
Detection of Spiculated Lesions in Digital Mammograms" and issued on Sept. 29, 1998 
to Roehrig, et. al., the entirety of which is hereby incorporated by reference herein, is to 

25 direct the attention of a radiologist to suspicious areas of the medical image that may 
reflect a threatening condition. While not a replacement for the experienced radiologist, 
CAD systems are designed to increase efficiency and reduce error, as a typical radiologist 
may be required to examine hundreds of medical images per day, which can lead to the 
possibility of a missed diagnosis due to human error. 
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[0004] Desired characteristics of a CAD system for analyzing medical images such as 
mammograms include high speed (requiring less processing time), high sensitivity or 
precision (the ability to detect more subtle indications of abnormalities), and/or high 
accuracy (lower false positives, i.e., the number of areas marked "suspicious" by the 
5 CAD system which, in reality, are not suspicious or indicative of a possibly cancerous 
condition and lower false negatives, also called "misses"). It is noted that although 
"mammogram" is sometimes used in the art to depict a set of four related films or views 
but sometimes used to depict one such view, for clarity purposes, the term 
"mammogram" shall correspond to one of the related films or views taken during the 

1 0 mammography process. 

[0005] Most commercial CAD systems today generally usually treat each digital 
medical image separately. In these CAD systems, the plurality of digital or digitized 
medical images are processed separately by the CAD system for detecting suspicious 
lesions. However, in radiology practice it is often useful to compare similar medical 

15 image views taken at different times and temporal comparisons may form an important 
part of the diagnostic procedure. Temporal comparisons can be made to detect interval 
changes indicating lesion growth, to monitor progression of a disease, and/or to estimate 
the effect of treatment. 

[0006] One area where temporal comparison of medical images plays a major role is 
20 breast cancer screening using mammography. For example, if a breast develops a 

potentially suspicious lesion over a period of time as reflected by periodic mammograms 
of that breast, such as every twelve months, the likelihood increases that it is a true 
lesion. Studies have shown that the use of prior mammograms in screening effectively 
reduces the number of false positive referrals. See for example, Thurfjell, M.G., Vitak, 
25 B., Azavedo E., Svane G., Thur^ell E., "Effect on Sensitivity and Specificity of 

Mammography Screening With or Without Comparison of Old Mammograms," ACTA 
Radiologica, 41(1) (2000) 52-56; and Bumside, E.S., Sickles, E.A., Sohlich R.E., Dee 
K.E., "Differential Value of Comparison With Previous Examinations in Diagnostic 
Versus Screening Mammography," American Journal of Roentgenology, 179(5) (2002) 
30 1 1 73-1 1 77, the entireties of which are incorporated by reference herein. This results 

from the fact that the use of prior mammograms allows radiologists to distinguish lesions 
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that grow from normal dense structures in the breast that somehow look suspicious. 
Temporal comparison of mammograms in a CAD system is described in U.S. 6,075, 879 
to Roehrig et. al, which is incorporated by reference herein. 

[0007] Breast cancer in women is a serious health problem, the American Cancer 
5 Society currently estimating that over 180,000 U.S. women are diagnosed with breast 
cancer each year. Breast cancer is the second major cause of cancer death among women, 
the American Cancer Society also estimating that breast cancer causes the death of over 
44,000 U.S. women each year. While at present there is no means for preventing breast 
cancer, early detection of the disease prolongs life expectancy and decreases the 

1 0 likelihood of the need for a total mastectomy. 

[0008] Currently, mammography using x-rays is the most common method of 
detecting and analyzing breast lesions. The current trend, however, is toward digital 
mammography. In the Netherlands, for example, where a nation-wide breast cancer 
screening program is implemented, about two million women in the 50 to 75 age group 

15 are invited once every two years for screening mammography. With an attendance of 
80%, about 800,000 women have a screening mammography every year. It is expected 
that within the next few years all screening xmits in the country will convert to digital 
mammography. During a two year transition period, digital mammograms will need to be 
read in combination with the prior film-screen mammograms. Currently, it is expected 

20 that all most recent prior film-screen mammograms will be digitized to allow soft-copy 
reading. 

[0009] Sometimes, temporal images are subtracted to enhance areas where 
differences occur. However, in conventional radiology the review of temporal image 
pairs may be seriously hampered by differences in acquisition. To some extent, 

25 positioning changes can be dealt with by geometric registration algorithms, the 
development of which received a lot of attention in recent years. See for example, 
Sallam, M.Y., Bowyer, K.W., "Registration and Difference Analysis of Corresponding 
Mammogram Images, Medical Image Analysis," 3(2) (1999) 103-1 18; and Wirth, M.A., 
Narhan, J., Gray, D., "Non-Rigid Mammogram Registration Using Mutual Information," 

30 Proc. SPIE Medical Imaging 2002: Image Processing, vol 4684 (2002) 562-573, the 
entireties of which are incorporated by reference herein. 
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[0010] The differences in acquisition are generally attributed to changes in exposure 
and to different screen-film imaging and/or digital imaging systems. These differences 
may cause subsequent mammograms to appear dramatically different and thus reduce the 
effectiveness of temporal comparisons. Thus, for example, when visually comparing a 
5 current-year mammogram to a prior-year mammogram on a softcopy display, a 
radiologist can have difficulty detecting subtle anatomical differences between the 
mammograms, because their different acquisition parameters can make them "look" very 
different in terms of grayscale levels. These differences may not be easily normalized as 
they may induce non-linear gray scale changes. Although radiologists may adjust the 

10 relative contrast, brightness and/or position of the threshold of the S-curve (the HD- 
curve, named after Hurter and Driffeld) of one or more images, such a process can be 
inaccurate, tedious, annoying, and time-consuming and may reduce performance and 
induce human errors. In other words, these acquisition differences cannot be easily or 
quickly corrected by the radiologists during display. In addition to negatively affecting 

15 visual comparison thereof, differences in grayscale settings/parameters between two 

temporally distinct mammograms of the same breast can be a disadvantage for temporal 
comparisons thereof in a CAD system, such as that described in U.S. 6,075, 879 supra. 
[0011] Accordingly, it would be desirable to facilitate visual comparison of two or 
more mammograms of a breast taken at different times and/or under different acquisition 

20 conditions. 

[0012] It would be further desirable to provide a computer-aided diagnosis (CAD) 
system that can effectively use information from multiple digital or digitized medical 
images, including sets taken at different times and/or under different acquisition 
parameters, to detect anatomical abnormalities therein. In a mammography setting, the 
25 multiple mammograms would be of the same or similar mammogram view of the same 
patient. 

SUMMARY OF THE INVENTION 
[0013] According to a preferred embodiment, numerical image processing algorithms 
are performed on two or more medical images to provide grayscale registration thereof, 
30 the numerical image processing algorithms being based at least in part on a model of 
medical image acquisition. The grayscale registered temporal images may then be 
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displayed and/or further processed for comparison thereof. Methods and systems 
grayscale registration of two or more medical images such as mammograms for 
facilitating visual comparison thereof and enhancing the speed and reliability of CAD 
detection of medical abnormalities are disclosed. It should be appreciated that the present 
5 invention can be implemented in numerous ways, including as a process, an apparatus, a 
system, a device, a method, or a computer readable medium such as a computer readable 
storage medium or a computer network wherein program instructions are sent over 
optical or electronic communication lines. Several inventive embodiments of the present 
invention are described below. 

10 [0014] As is evident, the parameter-based method for grayscale registration of one 
image to another image uses information in those images and the image acquisition 
method of each image. The image acquisition method of each image is used in order to 
select the appropriate parametric transform model from a set of predetermined parametric 
transform models. The method includes spatially registering the two images and 

15 performing gray scale registration. The gray scale registration involves generating a 
transform lookup table and using the transform lookup table to transform and register 
pixel values of one image to the pixel values of the other image. To generate the 
transform lookup table, a joint histogram may be generated from the two images and 
parameters of the predetermined parametric transform model are statistically fit to the 

20 joint histogram. 

[0015] The various acquisition models described herein take into account many of the 
most relevant steps in the image acquisition that influence pixel value differences 
between images. The parameter-based model provides a transform function or lookup 
table TA,B{gA) to transform or register pixel values in one image to those on another 

25 image. The methods are particularly suited for temporal comparisons of medical images 
such as mammograms. In addition, the transformation facilitates comparison of analog 
with digital images, i.e., combinations of unprocessed digital and digitized film-based 
mammograms by a radiologist. The method is based on a model of acquisition, which 
makes it relatively unsusceptible to differences between the images that are not due to 

30 acquisition, while other differences do not greatly affect the quality of transformed 
images negatively. 
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[0016] The method enables a radiologist to make quick, effective and efficient 
temporal comparisons of medical images and thus requiring fewer manual and subjective 
adjustments to be made by the radiologist for optimal display of the mammograms. In 
addition or alternative to image display, the transformation method may also be used for 
5 computer aided detection methods that make use of temporal other comparative 
information. 

[0017] According to one preferred embodiment, a method for registering a first image 
to a second image generally includes spatially registering the first image and the second 
image relative to each other, generating at least one pixel value histogram based on pixel 

10 values of the first and second images, generating a lookup table based on the at least one 
pixel value histogram, a first image acquisition method for the first image and a second 
image acquisition method for the second image, and applying the lookup table to the 
pixel values of the first image to generate a third image, the third image being 
transformed from the first image and registered to the second image. Preferably, the 

15 histogram is a joint histogram of the first and second images and the predetermined 
parametric transform functions are one-dimensional monotonic functions. 
[0018] Spatial registration may include segmenting the breast or other target from the 
rest of the image, geometric registration (e.g., translating, rotating, shearing and/or 
scaling), and cropping the images so that only images of the target in both the first and 

20 second images remain. The cropped images are used to generate that histogram. 

[0019] According to another preferred embodiment, a method for registering a first 
image to a second image generally includes generating a joint pixel value histogram 
using pixel values of the first and second images, selecting a parametric transform 
function from a plurality of predetermined parametric transform functions, the selecting 

25 being based on a first image acquisition method for the first image and a second image 
acquisition method for the second image, and statistically fitting parameters of the 
selected parametric transform function to the joint pixel value histogram, the statistically 
fitting determines the values of the parameters. 

[0020] According to yet another preferred embodiment, a system for registering a 
30 first image to a second image generally includes an input for receiving data for the first 
and second images and a processor configured to generate a joint pixel value histogram 
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using pixel values of the first and second images, select a parametric transform function 
from a plurality of predetermined parametric transform functions based on a first image 
acquisition method for the first image and a second image acquisition method for the 
second image, and statistically fit parameters of the selected parametric transform 

5 function to the j oint histogram to determine the values of the parameters. 

[0021] According to yet another preferred embodiment, a computer program product 
for directing a computing apparatus to automatically register two medical images are 
provided to implemented the grayscale image registration methods. 
[0022] These and other features and advantages of the present invention will be 

1 0 presented in more detail in the following detailed description and the accompanying 
figures which illustrate by way of example the principles of the invention. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0023] The present invention will be readily understood by the following detailed 
1 5 description in conjunction v^dth the accompanying drawings, wherem like reference 
numerals designate like structural elements, 

[0024] FIG. 1 A shows an outside view of a computer aided diagnostic (CAD) 
system. 

[0025] FIG. IB is a block diagram of a CAD processing unit of the CAD system. 
20 [0026] FIG. 2 is a flowchart illustrating an overall parametric grayscale registration 
process performed by the CAD system for model-based grayscale registration of two 
images. 

[0027] FIG. 3 is a flowchart illustrating a step of generating a transformation 
function TA.dgA) is more detail. 
25 [0028] FIG. 4 shows four panels that illustrate the steps of image acquisition that are 
modeled in order for a screen-film mammography to go from one pixel value of Image A 
to the corresponding pixel value of Image B. 

[0029] FIG. 5 shows a transformation between pixel values for two screen-film 
images A and B. 

30 [0030] FIG. 6 shows empirically obtained sensitometric curves (characteristic 
curves) for two illustrative types of film. 
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[0031] FIG. 7 is a flow diagram illustrating steps for determining a histogram 
transformation between two screen-film mammograms. 

[0032] FIG. 8 are plots for illustrative transformations for some parameter values. 
[0033] FIG. 9 are illustrative results for a digital to analog transformation. 
[0034] FIG. 10 are illustrative results for an analog to analog transformation. 
[0035] FIGS. 11 and 12 show the transformation curves Ta,b and the cumulative 
distribution functions cdfCge) for the examples of FIGS. 9 and 10, respectively. 
[0036] FIGS. 13A-13D illustrate an example of an analog to digital transformation in 
which FIGS. 13A and 13B are input images, FIG. 13C shows a transformed image, and 
FIG. 13D contains the scatter plot of pixel-values together with a plot of the parametric 
model. 

[0037] FIGS. 14A-14D illustrate an example of an analog to digital transformation in 
which FIGS. 14A and 14B are input images, FIG. 14C shows transformed image, and 
FIG. 14D contains the scatter plot of pixel- values together with a plot of the parametric 
model. 

DESCRIPTION OF SPECIFIC EMBODIMENTS 

[0038] The following description is presented to enable any person skilled in the art 
to make and use the invention. Descriptions of specific embodiments and applications 
are provided only as examples and various modifications will be readily apparent to those 
skilled in the art. The general principles defined herein may be applied to other 
embodiments and applications without departing fi:om the spirit and scope of the 
invention. Thus, the present invention is to be accorded the widest scope encompassing 
numerous alternatives, modifications and equivalents consistent willi the principles and 
features disclosed herein. For purpose of clarity, details relating to technical material that 
is known in the technical fields related to ±e invention have not been described in detail 
so as not to unnecessarily obscure the present invention. 

[0039] FIG. lA shows an outside view of a computer aided diagnostic (CAD) system 
100, such as an Image Checker Ml 000 from R2 Technology, Inc., for assisting in the 
identification of suspicious lesions in medical images such as mammograms. CAD 
system 100 generally includes a CAD processing unit 102 and a viewing station 104. 
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The CAD processing unit 102 may scan and digitize an x-ray image, such as a developed 
x-ray mammogram 106, into a digital image and/or receive a digital image as input. 
According to a preferred embodiment, the CAD processing unit 102 receives at least two 
mammogram images of a same or similar view of the same breast, e.g., the craniocaudal 

5 (CC) or the mediolateral oblique (MLO) view, taken at different times in order to 
facilitate comparison of multiple medical images. The CAD processing unit 102 then 
processes the digitized and/or digital images to register the images relative to each other 
and outputs grayscale registered digital images for viewing at the viewing station 104. 
Additionally or alternatively, the CAD processing unit 102 may perform image 

10 processing steps to process at least one of the grayscale registered digital image in order 
to display a highlighted digital image having information directing the attention of the 
radiologist to suspicious areas. Preferably, the image process steps takes into account a 
comparison of the multiple medical images. 

[0040] FIG. IB is a block diagram illustrating the CAD processing unit 102 in more 

15 detail. The CAD processing unit 102 generally includes a digitizer 108, such as a laser 
scanner with 50 micron resolution, for digitizing the developed image 106 such as a 
developed x-ray mammogram. The CAD processing unit 102 generally also includes 
elements necessary for performing image processing including parallel processing steps. 
In particular, CAD processing unit 102 may also include elements such as a parallel 

20 processing imit 1 10, a central control unit 1 12, a memory 1 14, and an I/O unit 116. It is 
to be appreciated that the parallel processing unit 110 shown in FIG. IB may be replaced 
by a single processor without departing from the scope of the preferred embodiments. It 
is to be further appreciated that in addition to the grayscale registration algorithms 
disclosed herein, the parallel processing unit 102 is capable of performing a multiplicity 

25 of other image processing algorithms. 

[0041] Referring again to FIG. lA, the viewing station 104 is preferably configured 
to allow the radiologist to conveniently view both the x-ray mammogram 106 and the 
output of the CAD processing unit 102 on a display device 118. The display device 118 
may be, for example, a CRT screen. The display device 118 typically displays grayscale 

30 registered digital mammogram that may be optionally highlighted with information to 
direct the attention of the radiologist to suspicious areas as determined by image 
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processing steps performed by the CAD processing unit 102. The viewing station 104 
may also include a station 120 for viewing the actual x-ray mammogram 106 and/or the 
actual digital mammogram itself, i.e., without grayscale registration and wdthout 
highlighting. The radiologist is assisted by the CAD system 100 by viewing the display 
5 device 118, which then facilitates comparison of multiple mammograms, such as a 
temporal comparison or a comparison of images of the left and right breast of a patient. 
The comparison helps with the detection by the radiologist of suspicious portions of the 
actual x-ray or digital mammogram itself. Further information regarding CAD system 
100 may be found in U.S. Pat. No. 5,815,591. 

10 [0042] The display device 1 18 of the viewing station 104 preferably displays at least 
two grayscale registered images of a same or similar view of one breast taken at different 
times in order to facilitate temporal comparison. It is noted that the CAD system 100 
may also be used in accordance with the preferred embodiments to simultaneously 
display information relating to multiple views of the same breast, similar views of 

15 opposing breasts, and/or views of a single breast taken at different points in time. Thus, 
after grayscale registration, the radiologist may better make comparisons. The CAD 
system 100 may optionally fiirther process the images to highlight specific areas of one or 
both of the mammogram images. 

[0043] Note that although the preferred embodiments are described herein with 
20 respect to detection systems that process and analyze mammography x-ray films and 
mammography digital images, the present invention is readily adaptable to many other 
types of CAD systems. The present invention may be applicable to CAD systems that 
process and optionally analyze any type of film-based or digital-based medical images. 
For example, other X-ray imaging devices, ultrasound imaging, magnetic resonance 
25 imaging (MRI), computed tomography (CT) imaging, positron emission tomography 

(PET), scintillation camera imaging, and nuclear imaging all produce images that may be 
film- or digital-based. Additionally, film-based medical images are carried on a wide 
variety of film-like materials such as vellum or any other transparent or translucent 
media. 

30 [0044] Although the description herein illustrates the registration of a first image to a 
second image, the method may be further applied to register additional images to the 
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second image, e.g., to facilitate comparison of mammogram images from the current 
year, one year prior, and two years prior, etc. In one preferred embodiment, the grayscale 
image registration method is applied to temporal mammograms, e.g., from two screening 
rounds. Alternatively, the multiple related medical images may correspond to two views 
5 of the same breast, to similar views of two opposing breasts, e.g., the MLO view of the 
left and right breast of a single subject. In yet another embodiment, there are more than 
two related mammograms wherein the first two are of the same view, e.g., the CC view, 
of the left and right breasts, and the others are of the same view of the left and/or right 
breast from one or more prior screenings. Generally, the images to be registered are of 

10 the same or similar view and can be of different (left and right) breast and/or taken at 
different times. It is to be appreciated that there are further combinations of the above 
mammograms to be input into the CAD processing unit that are within the scope of the 
preferred embodiments. It is to be fiirther appreciated that the historical mammogram that 
was taken months or years earlier may be stored in digitized form in CAD memory 114, 

15 or other digital storage medium, without departing from the scope of the preferred 

embodiments. Indeed, the CAD memory 1 14 or other storage medium may contain an 
entire historical archive of prior digital mammograms taken of the same patient, and 
CAD processing unit may be modified to compare any of these historical digital 
mammograms of the same view derived therefrom to the current digital mammogram. 

20 [0045] One reason to match or register multiple mammograms is to lessen the 
irrelevant differences between images due to acquisition. These differences may be 
attributable to variations in breast compression, exposure time, incident radiation 
intensity, and either film properties and digitization for screen-film mammograms or 
detector response for unprocessed digital mammograms. The grayscale registration 

25 method described herein could help reduce the radiologist's efforts to detect relevant 
differences like abnormal growth in breast tissue that signals breast cancer. In addition, 
the grayscale registration method may also be applicable in subtraction radiology and/or 
in the computer aided detection of abnormalities in temporal or other comparative 
mammograms. 

30 [0046] The grayscale registration method utilizes histogram matching. Histogram 
matching generally refers to methods that match images with the same or similar content 
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by adjusting look-up tables of pixel values. Conventional histogram matching is 
typically a one-dimensional process. In general, histogram matching methods can be 
classified as (1) non-parametric methods that attempt to find tuples of gray values that 
match as closely as possible or (2) parametric methods that require the estimation of 
5 parameters. Conventional parametric methods are ad hoc and often based on simple 
polynomial functions. 

[0047] The grayscale image registration method according to a preferred embodiment 
utilizes a parametric technique to match the pixel value distributions of two 
mammograms of the same patient. In contrast to the conventional ad hoc parametric 

10 matching methods, the parametric grayscale registration method of the preferred 

embodiment is derived fi-om an understanding as to why the value of a pixel is different 
in different images so as to match two images in a more "natural" way. In other words, 
instead of arbitrarily shifting and/or scaling the pixel values of one image to match the 
other or directly mapping one histogram to the other, the parametric grayscale image 

15 registration method models differences in acquisition of the images. These acquisition 
differences may include variations in (1) breast compression; (2) exposure time; (3) 
incident radiation intensity; and, (4a) film properties and digitization for screen-film 
mammograms, or (4b) detector response for unprocessed digital mammograms. The 
method of transformation being based on a model of acquisition allows more natural and 

20 accurate registration of pixel values than conventional ad hoc registration methods. 

[0048] By modeling the acquisition differences, an objective transformation between 
the two screen-film images is determined. One key advantage of this parametric method 
is that many unknown acquisition parameters in the model cancel out to result in a 
parametric model with fewer degrees of fi-eedom which need to be estimated or otherwise 

25 fitted from the pixel value distributions of the two images themselves. As a resuh, the 
method does not require a priori knowledge of specific settings of acquisition to match 
histograms and the separate acquisition parameters of sub-models are not retrievable 
from the fitted parameters. In addition, by having to estimate or fit only a few remaining 
degrees of freedom, the parametric method is more stable and reliable. With the 

30 parametric method, it is possible to match digitized screen-film mammograms (also 

referred to herein as analog mammograms) as well as unprocessed digital mammograms 
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in any of the four possible combinations: analog to analog, analog to digital, digital to 
analog, and digital to digital. 

[0049] FIG. 2 is a flowchart illustrating an overall parametric grayscale registration 
process 200 performed by the CAD processing unit 102 on two images. As noted above, 

5 . the two images may be images that were taken at different times to facilitate temporal 
comparison of the images. The two images may also be images of the same view of the 
left and right breasts taken at the same or different times. The CAD system receives 
image A at step 202 and image B at step 204. The images may be any combination of 
digital and analog images, e.g., two digital images, two analog images, or an analog and a 

10 digital image. For example, where the received image is an x-ray image, such as a 
developed x-ray mammogram, the CAD system may additionally digitize the received 
analog image. As another example, the CAD system may directly receive an 
unprocessed digital mammogram as the input image. 

[0050] Next, pre-processing geometric registration steps 206-210 are performed. 

1 5 Geometric registration ensures that the histograms generated from the images to be 
matched are based on the same tissue as much as possible. If this is not true, for 
example, if in one image the pectoral muscle is visible and in the other image it is not, 
then the histograms would not be correctly matched. Similarly, if in one image a larger 
part of the background is visible than in the other image, then histogram matching would 

20 have no significance. 

[0051] In particular, at step 206, the breast (tissue) in images A and B are segmented 
so that the pectoral muscle and background portions of the images are removed and only 
the breast (tissue) remains. The breast (or other target tissue) portions of the images are 
then geometrically registered at step 208. Geometric registration is achieved by global 

25 translation in x and y directions, rotation, scaling, and shearing as these parameters are 
generally at least slightly different between the images of the breast in the images A and 
B. Geometric registration is preferably achieved by optimization of the entropy 
correlation coefficient, i.e., normalized mutual information, as disclosed in Maes, F., 
CoUignon, A., Vandermeulen, D., Marchal, G., Suetens, P., "Multimodality Image 

30 registration by Maximisation of Mutual Information," IEEE Transactions on Medical 

Imaging, 16(2) (1997) 187-198, the entirety of which is incorporated by reference herein. 
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In one illustrative implementation, the pixel value range is down-sampled to 6-bits and 
the pixel value histograms are equalized before registration for faster processing. The 
entropy correlation coefficient can be subsequently optimized on a 64 x 64 grid of pixel 
value combinations. After a first pass on the (segmented) tissue area, a second pass can 
5 be made on the corresponding regions with tissue for fine -tuning. After geometric 

registration in step 208, the images are preferably cropped at step 210 so that only tissue 
that is visible in both images is taken into account in the histograms. The step may 
involve cropping some of the image of the breast (target) where one image includes more 
of the target than the other image. Once the pixel value transformation between the two 
10 images is determined, then preferably the entire (uncropped) image A is matched to 
image B (or vice versa). 

[0052] In order to find corresponding tissue in the images, precise geometric 
registration is generally not required. Finding a rough outline typically is sufficient for 
the purpose of finding corresponding tissue in the images. However, if histograms are 
15 matched by an entire parametric model rather than a restricted parametric model (as will 
be discussed infira), a pixel-to-pixel correspondence is desired, making geometric 
registration a more important component of histogram matching. The demands for 
precise geometric registration would be higher in subtraction radiology but affine 
transformations are sufficient as a pre-processing step for gray scale registration. Non- 
20 rigid registration of the images may be employed for more precise results. 

[0053] It is noted that steps 206-210 are merely illustrative pre-processing geometric 
registration steps. Variations to steps 206-210 may be implemented. For example, where 
the images are of the same view of the left and right breasts, the one image may be 
flipped or mirrored to facilitate spatial and grayscale registration processing. After the 
25 grayscale transformation is complete, the mirrored image may be converted to the 
original configuration for display to the radiologist. 

[0054] Next, at step 212, a lookup table or transformation fimction TA,B(gA) is 
generated using the pixel values of the cropped images A and B. The lookup table J^,B(g) 
maps a pixel value in image A to a pixel value in image B. As is evident, a lookup table 
30 Tsjig) for mapping in the reverse direction, i.e., for mapping a pixel value in image B to 
a pixel value in image A, can also be determined using similar modeling and methods. 
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The generation of the transformation function TA,B(gA) will be described in more detail 
below. 

[0055] At step 214, the transform lookup table TA^aig) is applied to values of image A 
to produce image C so that the image A is registered in grayscale to image B. Portions of 
5 the process 200 may be repeated where more than two images are to be compared. The 
additional images are preferably registered to the same image, i.e., image B. At step 216, 
images B and C can be simultaneously displayed on a monitor for visual comparison such 
as by a radiologist. Altematively or additionally, the CAD system may further perform 
image processing steps to compare images B and C so as to highlight information in at 

10 least one of the images B and C, preferably at least the more current image, in order to 
direct the attention of the radiologist to any suspicious areas. Such temporal comparisons 
can be carried out by the CAD system as described in US Pat. No. 6,075,879 entitled 
"Method and System for Computer- Aided Lesion Detection Using Information From 
Multiple Images" and issued on June 13, 2002 to Roehrig et al., the entirety of which is 

1 5 incorporated by reference herein. 

[0056] Step 212 of generating the transformation function TA,B{gA) is illustrated in 
more detail in the flowchart of FIG. 3. In particular, the transformation function 
generation includes creating a joint histogram of images A and B at step 232. Various 
parameters of a predetermined, one-dimensional monotonic function are statistically fit to 

20 the joint histogram at step 234 using, for example, a least squares method. The 

predetermined, one-dimensional monotonic function is selected from one of a set of 
predetermined functions according to a physical acquisition model for image A and a 
physical acquisition model for image B. After the parameters are statistically fit to the 
joint histogram, the lookup table Ta,b{^ is generated at step 236. 

25 [0057] The process 212 of generating the transformation function TA,B{gA) and the 
predetermined functions will be further explained with a more detailed discussion of the 
parametric modeling below. In particular, FIG, 4 shows four plots or panels that 
illustrate the steps of image acquisition that are modeled in order for a screen-film 
mammography to be transformed from a given pixel value of Image A (Panel I) to a 

30 corresponding pixel value of Image B (Panel IV). Panels I and IV illustrate the 

probability density functions (pdfs) of the gray values gA, gs of image A and image B, 
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respectively. Panel II illustrates the characteristic curves of the films for images A and B 
in which optical density, i.e., blackening of the film is plotted against log(exposure). 
Lastly, Panel III illustrates the probability density fimctions of log(exposure) for images 
A and B. Panel III gives an exaggerated transformation of log(exposure). The dotted 
5 lines show the paths of one illustrative pixel value for each of images A and B. 

[0058] By combining the chain of events illustrated in the four panels of FIG. 4, an 
objective transformation between pixel values for the two screen-film images A and B is 
determined, as shown in FIG. 5. Many of the unknown acquisition parameters in the 
model are canceled out to result in a parametric model with fewer degrees of freedom 
10 which are estimated or fitted fi-om the pixel value distributions of the two images 



themselves. 



TABLE I 


J* 


location on imaee f2-vector'i 


b(T) 


exposure 


M(r) 


attenuation coefficient 


V, <l> 


relative onset and size of digitization range 


y 


linear response of fiiU field digital mammography (FFDM): g = yb 


od 


optical density 




extrema of characteristic curve 




shift and slope of characteristic curve 


dAigA) 


pixel value distribution function of gA 


dA.BigA, gs) 


joint pixel value distribution function of gA, ge 


DAigA) 


cumulative pixel value distribution fiinction of gA 


Ga 


indexed pixel value 


gA 


normalized pixel value e [0, 1] 




P% quantile of c/^(g^) 


h(r) 


breast thickness 




incident and exiting radiation intensity 


n 


number of discrete pixel values 


t 


exposure time 


TA.B(gA) 


model for look-up table 


X, a 


compovmd parameters 


Ah 


compoimd parameter {hsIhA} 


Abo 


compound parameter \ ^(^3/0 j^) - ^\n{tj^^) \ 



[0059] For purposes of clarity. Table I lists various parameters used to describe the 
parametric modeling and their corresponding definitions. Pixel value distribution 
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functions flf^(g) and deig) can be derived from the pixel values of images A and B. Using 
the pixel value distribution functions dAig) and dsCg), a lookup table or transformation 
function TA,B{g) is derived to map a pixel value in image A to a pixel value in image B. 
As is evident, a lookup table Tsjig) in the reverse direction can be determined with 
5 similar modeling and methods. 

[0060] The transformation lookup table TA,B(g) is determined so as to achieve similar 
cumulative pixel value distribution fimctions Z)^(g) and Daig) for the images after the 
transformation. For image pairs without a global contrast reversal, i.e., analog to analog 
and digital to digital, the cumulative pixel value distribution functions Z)^(g) is given by: 

10 D,ig,)= ]d,{y)dy « \d,{Y)dY = D,(g, = T,j,ig,)). (1) 

[0061] For image pairs with a global contrast reversal, i,e,, between analog and 
digital, the integration limits for the second integral in (1) are from TA^sigA) to the 
maximum pixel value and results in: 

Da (g^) ^ 1 - Db (gB = Ta,b (gA)). (1 A) 

1 5 [0062] As noted above, conventional ad hoc methods exist that match two 

histograms, e.g., by shifting the overall brightness, i.e., Ta,b (g)=g- go, or by also 
changing the contrast, i.e., Ta,b (g) ^c{g- go^ Such ad hoc methods are mostly 
independent of the way the images are obtained and are generally applied to normal 
photographs, infrared images, or any other kind of image pairs of the same modality. 

20 However, these conventional ad hoc methods are not well suited for histogram matching 
on a combination of a digital and an analog medical image such as a mammogram. 
Another conventional method is a non-parametric method that may be suited for 
histogram matching on a combination of a digital and an analog medical image such as a 
mammogram. 

25 [0063] Parametric Modeling of Acquisition Parameters 

[0064] The present parametric modeling takes into account some of the most relevant 
parameters in the acquisition that influence pixel value differences between images. The 
acquisition parameters include breast compression, exposure time, intensity of incident 
radiation, and either characteristic film curve and digitization for screen-film (analog) 
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mammography or detector response for unprocessed digital mammography. The 
modeHng of each of these acquisition parameters will now be described. 
[0065] To model breast compression and intensity of incident radiation, a simple 
approximation can be used that takes exposure differences due to tissue thickness 
5 differences into account. In a model for mono-energetic X-rays, the intensity attenuation 
due to the breast tissue is related to breast thickness h(r) by i(r) = io exp (-//(r) /^(r)), 
where k is the radiation intensity of the incident beam and ju(v) is the mean attenuation 
per unit of length for X-rays at location r. This relation is known as Beer's law. See, for 
example, Barrett, H. H., Swindell, W., "Radiological Imaging: the Theory of Image 
10 Formation, Detection, and Processing," Vol. I and II (1981), Academic Press, Inc. The 
exposure at location r on the film is obtained by multiplication of radiation intensity /(r) 
by the exposure time t, i.e., 

b(r) = ti,oxp(^ju(r)hir)). (2) 

[0066] The relationship between the exposure in image A, 6^(r), and the exposure in 
15 image B, ^^(r), is obtained by assuming that the attenuation coefficient ju(r) remains 

constant for corresponding locations r of the images. It is further assimied that the breast 
thickness ratio hB{v)lhA{r) does not depend on location r and is thus an unknown constant 
Ah = hsIhA^ Because the breast is compressed between two parallel compression plates, 
this assumption is valid for at least the interior part of the breast if projection angle 
20 differences of X-rays are small. In addition, for the region near the breast edge where the 
breast bulges out, this assumption is reasonable because a proportional decrease of 
thickness will occur in both images. After the attenuation coefficient //^(r) is equated to 
attenuation coefficient //^(r), the following linear relation is obtained: 

In (r) = ^ In 6^ (r) + \n{t,i, ,)-^ ln{tj, J = A/2 In 6, (r) + At, . (3) 

f^A ^A 

25 where breast thickness ratio hsIhA is the unknown constant Ah and \n{tf^iQ Q ) - 

QisIhA) (ln(?^/o ^) is an unknown constant Abo. Where the acquisition settings for the two 

images are similar, i.e., Ah^l and Abo^ 0, the relationship between the exposure in 
images A and B is approximately equal, i.e., 6^ ~ bA. The two unknown constants Ah and 
Abo will be absorbed in subsequent steps in developing the transformation model. 
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[0067] As noted above, for screen-film mammography, the parametric modeling also 
takes into account characteristic film curve and digitization as these are also some of the 
most relevant parameters in the acquisition that influence pixel value differences between 
images. The characteristic curve, also referred to as the HD-curve after Hurter and 
5 Driffeld (see Hurter, F. & Driffeld, V.C.: Photo-chemical investigations and a new 
method of the sensitiveness of photographic plates, The Journal of the Society of 
Chemical Industry (1890) 455^69), gives the relationship between the log (exposure), 
i.e., log b(r\ and the corresponding optical density, od, after development of the film. 
This relationship, i.e., the characteristic film curve, is illustrated in and described above 
10 with reference to Panel II of FIG. 4. The logistic fimction is used as a model for the 
characteristic film curve: 

= od • + ^^"^ax -O^min 

[0068] Illustrative empirically obtained sensitometric or characteristic curves are 
shown in FIG. 6 merely as examples. In particular, FIG. 6 shows empirically obtained 

15 sensitometric curves for two illustrative types of film, i.e., Kodak MIN-R2000 and Agfa 
HDR along with their best fitting (least squares) logistic functions. 
[0069] In digitization of the analog image, it is assumed that the relationship between 
optical densities, od, and pixel values, G, is linear (for n-bits digitization: 0 < G < 2'^ - 1). 
Some digitizers produce pixel values that have an exponential relation with optical 

20 density, i.e., a linear relation with luminance. However, after converting the pixel values 
to a linear relation with optical densities, the following equations are still valid. For 
convenience, the digitization range is defined relative to the dynamic range of the 
characteristic curve, i.e., relative to the range odm\n to odmax^ {odmin + v(odmsK - odmin)} is 
defined as the maximum value of the optical density that is digitized, i.e., with the 

25 minimum pixel value, and [od^^^ +(y- fiipd^^ - od^^ )} is defined as the minimum 
value of the optical density that is digitized, i.e., with the maximum pixel value. 
Parameters v and ^ are defined as the relative onset and size of digitization image, 
respectively and are larger than zero. If the dynamic range of the characteristic curve is 
precisely digitized then v = ^ = 1 . The linear relation between normalized pixel values, g, 
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and optical densities, od, is given by 



gipd) = 



'v- f -^^7 le[0,l]. (5) 

V max mm / 



2"-l <z> 

[0070] Substituting (4) into (5) cancels out the dynamic range parameters, odmin and 
odmax and gives the combined film-digitizer characteristic curve as: 



1 

1 + ^' 



[0071] By incorporating digitization ranges, some pixel values may be invalid in the 
model. All pixel values with v-g^e [0,1] correspond to optical densities in the dynamic 
range of the characteristic curve while all other pixel values, i.e., v- <0 or 
v-g^>l should not exist. If v-^>0 or v <l then less than the entire dynamic range 
10 of the characteristic curve is digitized. In such cases, the clipping of large and/or small 
pixel values is preferably taken into account. 

[0072] For digital mammography, as noted above, the parametric modeling also takes 
into accoimt the detector response as it is another one of the most relevant parameters in 

the acquisition that influences pixel value differences between images. For digital 
15 mammography, the relationship between exposure b and pixel value g is approximately 
linear for a wide exposure range and is given by: 

g(6) = ^ = 7*€[0,l]. (7) 

[0073] The above-described models for modeling some of the most relevant 
parameters in the image acquisition that influence pixel value differences between images 
20 are summarized in TABLE II. As noted, the acquisition parameters include breast 

compression, exposure time, intensity of incident radiation, and either characteristic film 
curve and digitization for screen-film (analog) mammography or detector response for 
unprocessed digital mammography. 
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TABLE II 



ItIUUCI 


A i^miicif inn l^sifsinnAfpf c l^^nHplpH 


In bg (r) = Ahlnb^ (r) + Ab^ . (3) 


Breast compression, incident radiation intensity, 
exposure time. 


^^*^%("-l + .-^^'»->) 


Combined film and digitizer characteristic curve. 


8ib) = ^^=]^e[0M (7) 


digital detector response. 



10 



15 



20 



[0074] Parametric Equations for Combinations of Analog and Digital Images 
[0075] With the parametric models of the image acquisition parameters as 
summarized in TABLE II, the parametric equations for transformation between various 
combinations of analog and digital images can be derived. The four combinations are 

analog to analog, digital to digital, digital to analog and analog to digital. 
[0076] For analog to analog image registration, parametric models (3) (compression- 
time-intensity function) and (6) (combined film-digitizer characteristic curve) are 
combined to derive the transformation function for two screen-film Images A and B: 

r \ 



9b 



1 



1 



(8) 



where the parameters X< and a are compound parameters that contain previously defined 
acquisition parameters and are given by: 

Pa 

Note that if the acquisition settings for images A and B are comparable, then ^ ^ 1, a - 1, 
« and » such that g^^ Sb- The flow diagram of FIG. 7 illustrates the steps 
for determining a transformation function between two screen-film mammograms. 
[0077] Similarly, for the digital to digital transformation fimction, parametric models 
(3) and (7) (digital exposure-pixel value function) are combined to derive the transform 
function for two digital Images A and B: 

^.=7:.,«(g.)=^^.^ (9) 
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where the compound parameters A, and a are given by: 



_1_ 



[0078] For the digital to analog transform function, parametric models (3), (6) and (7) 
are combined to derive the transform function: 



(10) 



where the compound parameters X and o are given by: 
[a = -Ah/3,. 

[0079] Lastly, for the analog to digital histogram transformation function, parametric 
models (3), (6) and (7) are combined to derive the transform function: 



1 



-1 



where the compound parameters X, and o are given by: 



(11) 



cr = 



Pa' 

[0080] Table III below summarizes the transform functions and the parameters for 
each of the four cases. Ahhough the same symbols X and o are used in the four 
parametric models, their meaning and valid ranges differ. In addition, although 
compound parameters X and a are defined for each of the four cases above, X and a are 
preferably treated as individual parameters in the histogram matching process. In 
addition, as noted above, for screen-film images, these relationships are valid when the 
pixel values correspond to optical densities in the dynamic range of the characteristic 
curve, i.e., when Q<v-(pg< \ , otherwise clipping of pixel values takes place. FIG. 8 are 
plots for some illustrative transformations for a few parameter values. Specifically, FIG. 
8 illustrates the transformations between two analog images (based on (8)), 
transformations between two digital images (based on (9)) and transformations between a 
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digital image and an analog image (based on (10)). In each plot involving an analog 
image, the full dynamic range of the characteristic curves is digitized for analog images, 
i.e., v= ^ = 1. 



TABLE III 1 


Transformation 


Transform function 


Parameters 


analog ► dndiog 




f \ 

1 
1 

— - — ir 

I ^a-^aSa J 


(8) 


At Ai ^/ \j A ✓T" 


digital — ► digital 


gB=T,ASA)-^gA (9) 




digital — ^ analog 


8b~^a,b(.Sa) ~ , 
9b 


f 1 ^ 


(10) 

I 




analog — > digital 


( 1 1 

gB=TA,B(SA) = '^ ^. 1 


(11) 





5 [0081] Fitting Parameters to Parametric Model: Restricted or Entire Model 
[0082] With the above four predetermined parametric models for the various 
combinations of analog and digital image transformations, histogram matching may be 
performed by selecting one of the four predetermined models based on the image 
acquisition (digital or analog) for each of the two images and estimating or otherwise 
10 fitting the values of the parameters for the appropriate model. The histogram matching 
may be performed using (1) restricted parametric model in which only the dynamic range 
of the characteristic curve is digitized (i.e., = = = = 1 and only estimate A,<t), 
e.g., FIG, 7, or (2) the entire parametric model. 

[0083] In the case of histogram matching using the restricted parametric model, the 
15 estimates of x,cf can be used as a first guess for an iterative process. It is noted that if the 
digitizer calibration and the minimum and maximum optical density of the screen-film 
system are known, pixel values can be rescaled before processing. 
[0084] To estimate the two unknown parameters X and a, (1) is used to require that 
the parameters X and a are set to simultaneously fulfill two quantiles. For example, the 
20 25% and 75% percentiles may be selected as the desired quantiles such that the following 
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(12) 



pair of equations would need to be satisfied: 

[0085] The 25% and 75% percentiles are merely illustrative quantiles and any 
suitable combination of non-equal quantiles may be employed. In case of a 
transformation between analog and digital images, the cumulative distribution function 
(cdf) of one image is preferably inverted before the quantiles are determined to account 
for the opposite sign in contrasts (see (1 A)). Hence, ^^^'^"^ ^(ioo%-p%) 
[0086] With = = = ^5 = 1 , all four transformations can be rewritten as shown 
in Table IV. 



TABLE IV 


Transformation 


Transform function 


analog analog 


=X (derived from (8)) 


digital —*■ digital 


gB = ^8 A (derived from (9)) 


digital -* analog 


=/lg^ (derived from (10)) 


analog digital 


8b =4 F (derived from (11)) 
V-8a) 



10 



15 



[0087] By substituting monotonically increasing functions (omitting the subscripts A 
and B and superscripts (25%) and (75%) for purposes of clarity): 



^ = ln 



' 8 ^ 



for analog images; 



^ = ln(g) for digital images, 

the general solution of (12) for all four transformations is given by 



(13) 



Z = exp( 



f e(25%) c(75%) _ j:{25%) j:{15%) \ 
hB hA hA hB 



e(75%) _ e(25%) 
^A ^A 



e(V5%) _ e( 

^ 

i:(75%) £:(25%) * 
hA hA 



(14) 
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[0088] Alternatively, the histogram matching may be performed using the entire 
parametric model. Although histogram matching is typically a one-dimensional process 
and that a one-dimensional lookup table is generated, the development of the lookup table 
is based on a two-dimensional joint distribution of pixel value pairs of images A and B. 
5 [0089] Ideally, the joint distribution of pixel value pairs would have all its mass on a 
one-dimensional curve after geometric registration and this one-dimensional curve would 
be a monotonically increasing (or decreasing) function, resulting from (1). The one- 
dimensional curve describes the transformation (gA, Ta,b (gA)). In the ideal case, 
histogram matching is thus a one-dimensional process. In practice, however, the joint 
10 distribution has scattered mass around the ideal curve. This may be due to, for example, 
errors in geometric registration and/or physical changes that occurred between the times 
that the mammograms are taken. 

[0090] If the geometric registration is reliable then the parametric models of (8) to 
(11) can be fitted to the distribution of pixel value pairs. Thus, histogram matching using 

15 the entire parametric model imposes greater demands on the quality of geometric 

registration than in the case of histogram matching using the restricted parametric model. 
Geometric registration was only used in the restricted parametric model to define the 
regions of overlap between the images and it was presiimed that within these regions 
tuples of pixels can be registered in principle but that the tuples themselves were not 

20 explicitly needed. Using the entire parametric model, the joint distribution of pixel value 
pairs is used to fit the model and thus a more precise registration is needed. Although in 
the geometric registration only afifine transformations are used, the joint distribution of 
pixel values is generally precise enough for fitting the parametric model. Better results 
can be obtained, however, when non-rigid registration of the images is employed, 

25 [0091] Histogram matching using the entire parametric model is achieved as follows. 
After geometric registration, a two-dimensional distribution, cIa^b (gA, gB\ is constructed 
by sampling pixel values gA and gB of the registered pixels. The appropriate 
transformation fimction Ta,b igA) (selected firom (8) to (11)) is subsequently fitted to this 
distribution by minimizing the sum of squared errors: 

"S^i" YLdAAg^>g,\gB-T,AgA)y- (15) 
parameters of r^.B g. 
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This requires an iterative optimization routine, in which the resuhs of histogram matching 
using the restricted parametric model are preferably used as a first guess for the values of 
the parameters. 

[0092] FIG. 8 are plots for some illustrative transformations for a few parameter 
5 values. Illustrative results for a digital to analog transformation are shown in FIG. 9 and 
those for an analog to analog transformation are shown in FIG. 10. In each of FIGS. 9 
and 10, the image on the left is an image to be mapped and the image on the right is the 
image to which the left image is to be mapped. The middle image is the resulting 
registered or mapped image of the left image. In particular, FIG. 9 illustrates the 
10 transformation of an unprocessed digital image (left) to a screen-film image made at the 
same day (right). FIG. 10 illustrates the transformation between two screen-film images 
(made with an interval of two years in between). 

[0093] FIGS. 11 and 12 show the transformation curves Ta,b and the cumulative 
distribution fiinctions cdf(gB) for the examples of FIGS. 9 and 10, respectively. In 
15 particular, FIGS. 11 and 12 each illustrates the cumulative distribution fiinction (cdf) of 
image A in the lower left while the cdf of image B are shown in the upper right. The 
dotted line is the cdf of the transformed Image A. The transformations Ta,b are shown in 
the upper left. 

[0094] As fiuther examples, FIGS. 13A-13D illustrate an analog to digital 
20 transformation while FIGS. 14A-14D illustrate an analog to analog transformation. 

FIGS. 13A and 13B are input images A and B, respectively. FIG. 13C shows image C 
which is the resuh of mapping image B (FIG. 13B) to image A (FIG. 13A). FIG. 13D 

contains the scatter plot of pixel- values together with a plot of the fitted parametric 
model. Note that in this example, the analog image is mapped to the digital image. The 

25 gray-values in FIG. 13D are proportional to log(pixel value pair counts). Note also that 
log-transformed pixel values are used in the scatter plot of FIG. 13D instead of the 
original pixel values. As a final step, based on artificial automatic exposure control, a 
look-up table was designed so as to display the digital image and the transformed analog 
image in a conventional manner. The pixel-pair counts in FIG. 13D are determined prior 

30 to this final step. 
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[0095] Similarly, FIGS. 14A and 14B are input images A and B, respectively. FIG. 
14C shows image C which is the result of mapping image B (FIG. 14B)to image A (FIG. 
14A). FIG. 14D contains the scatter plot of pixel-values together with a plot of the fitted 
parametric model. The gray-values in FIG. 14D are proportional to log(pixel value pair 
5 counts). 

[0096] As is evident, the parameter-based method for grayscale registration of one 
image to another image uses only information in those images and the image acquisition 
method of each image. The image acquisition method of each image is used in order to 
select the appropriate parametric transform model from a set of predetermined parametric 

10 transform models. The method includes spatially registering the two images and 
performing gray scale registration. The gray scale registration involves generating a 
transform lookup table and using the transform lookup table to transform and register 
pixel values of one image to the pixel values of the other image. To generate the 
transform lookup table, a joint histogram may be generated from the two images and 

15 parameters of the predetermined parametric transform model are statistically fit to the 
joint histogram. 

[0097] The various acquisition models described herein take into account many of the 
most relevant steps in the image acquisition that influence pixel value differences 
between images. The parameter-based model provides a transform function or lookup 

20 table TA,B(gA) to transform or register pixel values in one image to those on another 

image. The methods are particularly suited for temporal comparisons of medical images 
such as mammograms. In addition, the transformation great facilitates comparison of 
analog with digital images, i.e., combinations of unprocessed digital and digitized film- 
based mammograms by a radiologist. The method is based on a model of acquisition, 

25 which makes it relatively unsusceptible to differences between the images that are not 

due to acquisition, while other differences do not greatly affect the quality of transformed 
images negatively. 

[0098] The method enables a radiologist to make quick, effective and efficient 
temporal comparisons of medical images and thus requiring fewer manual and subjective 
30 adjustments to be made by the radiologist for optimal display of the mammograms. In 
addition or alternative to image display, the transformation method may also be used for 
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computer aided detection methods that make use of temporal or other comparative 
information. 

[0099] While the preferred embodiments of the present invention are described and 
illustrated herein, it will be appreciated that they are merely illustrative and that 
5 modifications can be made to these embodiments without departing from the spirit and 
scope of the invention. Thus, the invention is intended to be defined only in terms of the 
following claims. 
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